Big Data Cloud Solution Architect

Job Description

The Role:
The Big Data Cloud Solution Architect will be responsible for guiding the full lifecycle of a Big Data solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing, and Test and Deployment in Cloud Infrastructures.
We are looking for candidates with a broad set of technology skills to be able to design and build robust Big Data solutions for big data problems and learn quickly as the platform grows:

• Provide advisory and thought leadership on the provision of analytics environments leveraging Cloud based platforms, big data technologies, including integration with existing data and analytics platforms and tools.
• Design and implement scalable data architectures leveraging Hadoop, NoSQL and emerging technologies, covering on-premise and cloud-based deployment patterns.
• Define, design and implement data access patterns for multiple analytical and operational workloads, across on-premise and Cloud based platforms
• Create information solutions covering data security, data privacy, metadata management, multi-tenancy and mixed workload management across Hadoop and NoSQL platforms, spanning on- premise and Cloud based deployments
• Delivery of customer Cloud Strategies, aligned with customer’s business objectives and with a focus on Cloud Migrations ensuring global to local regulations, security, risk and compliance

Skills – Must Have
Leadership

• Provide knowledge in the Big Data ecosystem with demonstrable hands on experience
• Provide input & vision to Big Data deployment standards and guidelines
• Lead by example with hands on practitioner’s knowledge

Technical:

• 5+ years hands-on experience with the Big Data stack (HDFS, SPARK, MapReduce, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka)
• 5+ years hands-on experience with the No-SQL (e.g. MongoDB, HBase, Cassandra)
• 5+ years hands-on experience with related/complementary open source software platforms and languages (e.g. Java, Linux, Apache, Perl/Python/PHP, Chef, Scala)
• 5+ years of experience working on cloud platforms - Pivotal Cloud Foundry and Public Cloud AWS/Azure/Google Cloud
• Hands-on experience with ETL (Extract-Transform-Load) tools (e.g. Informatica, Talend, Pentaho)
• Knowledge / Hands-on experience with BI tools and reporting software (e.g. Microstrategy, Cognos, Pentaho)
• Hands-on experience with analytical tools, languages, or libraries (e.g. SAS, SPSS, R, Mahout, MLLib)
• Hands-on experience with "productionalizing" Big Data applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)
• Hadoop platforms & distributions: Cloudera, Hortonworks, MapR, EMR
• Previous experience with high-scale or distributed RDBMS (Teradata, Netezza, Greenplum, Aster Data, Vertica, DB2, Oracle)
• Proficient understanding of Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data Center Networking)
• Strong understanding across Cloud and infrastructure components (server, storage, network, data, and applications) to deliver end to end Cloud Infrastructure architectures and designs.
• Knowledge of further Cloud technologies (Redshift, S3, EC2, EMR, Talend/Pentaho/Snowflake)
• Track record of thought leadership and innovation around Big Data. Solid understanding of Cloud Computing Technologies and related emerging technology (e.g. Amazon Web Services EC2, Elastic MapReduce, Azure, GCP) and considerations for scalable, distributed systems Knowledge of NoSQL platforms (e.g. key-value stores, graph databases, RDF triple stores)

Consulting & Communications

• Self-starter, with a keen interest in technology and highly motivated towards success
• Must show initiative and desire to learn business subjects
• Experience working in client facing / consulting environments, to be able to build trusted relationships with client stakeholders and act as a trusted adviser.
• Strong organizational and written/verbal communication skills
• Excellent presentation skills
• Understand and mitigate risks & issues
• Lead a team of SMEs to deliver the desired solution
• Prior experience of managing team in onsite-offshore model is an added advantage

Skills – Should Have

• Broad knowledge of core business and processes in financial services, insurance and retail etc.
• Comfortable working in a fast paced, changing environment
• Take ownership of the overall Big Data solution and present the vision and roadmap to the various stakeholders
• Provide leadership in infrastructure migration methodologies and techniques including mass application movements into the Cloud within large regulated enterprise environments